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Abstract 

We study many-server queues with abandonment in which customers have general service 
and patience time distributions. The dynamics of the system are modeled using measure- 
valued processes, to keep track of the residual service and patience times of each customer. 
Deterministic fluid models are established to provide first-order approximation for this model. 
The fluid model solution, which is proved to uniquely exists, serves as the fluid limit of the 
many-server queue, as the number of servers becomes large. Based on the fluid model solution, 
first-order approximations for various performance quantities are proposed. 

Key words and phrases: many-server queue, abandonment, measure valued process, quality 
driven, efficiency driven, quality and efficiency driven. 

1 Introduction 



Recently, there has been a great interest in queues with a large number of servers, motivated by 
applications to telephone call centers. Since a customer can easily hang up after waiting for too 
long, abandonment is a non-negligible aspect in the study of many-server queues. In our study, a 
customer can leave the system (without getting service) once has been waiting in queue for more 
than his patience time. Both patience and service times are modeled using random variables. A 
recent statistical study by Brown et al. [2] suggests that the exponential assumption on service time 
distribution, in many cases, is not valid. In fact, the distribution of service times at call centers may 
be log- normal in some cases as shown in [2]. This emphasizes the need to look at the many-server 
model with generally distributed service and patience times. 
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In this paper, we study many-server queues with general patience and service times. The 
queueing model is denoted by G/GI /n+GI . The G represents a general stationary arrival process. 
The first GI indicates that service times come from a sequences of independent and identically 
distributed (IID) random variables with a general distribution. The n denotes the number of 
homogeneous servers. There is an unlimited waiting space, called buffer, where customers wait 
and can choose to abandon if their patience times expires before their service starts. Again, the 
patience times of each customer are IID and with a general distribution (the GI after the '+' sign). 

Useful insights can be obtained by considering a many-server queue in limit regimes where the 
number n of servers increases along with the arrival rate A" such that the traffic intensity 

p = > p as n ^ oo, 

n/i 

where /i is the service rate of a single server (in other words, the reciprocal of the mean service 
time), and p S [0, oo). Since the abandonment ensures stability, the limit p in the above need not 
to be less than 1. In fact, according to /3, the limit regimes can be divided into three classes, i.e. 
Efficiency-Driven (ED) regime when p > 1, Quality- and- Efficiency- Driven (QED) regime when 
/9 = 1 and Quality- Driven (QD) regime when p < 1. The QED regime is also called Halfin-Whitt 
regime due to the seminal work Halfin and Whitt [I 1]. With this motivation, we establish the fluid 
(also called law of large number) limit for the G/GI /n+GI queue in all the ED, QED and QD 
limit regimes. 

We show that the fluid model has an equilibrium, which yields approximations for various 
performance quantities. These fluid approximations work pretty well in the ED and QD regime 
where p is not that close to 1, as demonstrated in the numerical experiments of Whitt [28]. However, 
when p is very close (say within 5%) to 1, the fluid approximations lose their accuracy and we shall 
look at a more refined limit, the diffusion limit, in this case. Diffusion limit is not within the scope 
of the current paper. 

One of the challenges in studying many-server queue with general service (as well as patience) 
time is that Markovian analysis can not be used. In a system where multiple customers are processed 
at the same time, such as the many-server queue, how to describe the system becomes an important 
issue. The number of customers in the system does not give much information since they may all 
have large remaining service times or all have small remaining service times, and this information 
can affect future evolution of the system. We choose finite Borel measures on (0, oo) to describe 
the system. At any time t > 0, instead of recording the total number of customers in service (i.e. 
the number of busy servers), we record all the remaining patience times using measure Z{t). For 
any Borel set G G (0,oo), Z{t){C) indicates the number of customers in server with remaining 
service time belongs to C at that time. Similar idea applies for the remaining patience times. 
We first introduce the virtual buffer, which holds all the customers who have arrived but not yet 
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scheduled to receive service (assuming they are infinitely patient). We record all the remaining 
patience times for those in the virtual buffer using finite Borel measure 7^(t) on M = (—00, 00). At 
time t > 0, TZ{t){C) indicates the number of customers in the virtual buffer with remaining patience 
time belongs to the Borel set C. The descriptor {TZ{-), Z{-)) contains very rich information, almost 
all information about the system can be recovered from it. Note that a customer with negative 
remaining patience time has already abandoned. So the actual number of customers in the buffer 
is 

Q{t) = TZ{t){{0, 00)) for all t > 0. 

More details will be discussed when we rigorously introduce the mathematical model in Section 2. 
In literature, another descriptor that keeps track of the ages of customers in service and the ages 
of customers in waiting have been used, e.g. [15, 28]; The age proceses have the advantage of being 
observable, without requiring future information, though their analysis is often more complicated. 
Both age and residul descriptions of the system often results in the same steady state insights. In 
this paper, we focus on residual processes only. 

The framework of using measure-valued process has been successfully applied to study models 
where multiple customers are processed at the same time. Existing works include Gromoll and 
Kruk [8], Gromoll, Puha and Williams [')] and Gromoll, Robert and Zwart [10], to name a few. 
Most of these works are on the processor sharing queue and related models where there is no 
waiting buffer. Recently, Zhang, Dai and Zwart [31, 30] apply the measure- valued process to study 
the limited processor sharing queue, where only limited number of customers can be served at any 
time with extra customers waiting in a buffer. Many techniques in this paper closely follows from 
those developed in [31]. There has been a huge literature on many-server queue and related models 
since the seminal work by Halfin and Whitt [ 1 I ] . But there are not many successes with the case 
where the service time distribution is allowed to be non-exponential. One exception is the work of 
Reed [25], in which fluid and diffusion limits of the customer-count process of many server queues 
(without abandonment) are established where few assumptions beyond a first moment are placed 
on the service time distribution. Later, Puhalskii and Reed [23] extend the aforementioned results 
to allow noncritical loading, generally distributed service times, and general initial conditions. 
Jelenkovic et al. [13] study the many-server queue with deterministic service times; Garmarnik and 
Momcilovic [(>] study the model with lattice-valued service times; Puhalskii and Reiman [24] study 
the model with phase-type service time distributions. Mandelbaum and Momcilovic [18] study 
the virtual waiting time processes, and Kaspi and Ramanan [] G] study the fluid limit of measure- 
valued processes for many-server queues with general service times. For the many-server queue with 
abandonment, a version of the fluid model have been established as a conjecture in Whitt [27], where 
a lot of insight was demonstrated, which help greatly in our work. Recently, Kang and Ramanan 
also worked on the same topic and summarized their result in the technical report [15]. Although 
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we focus on the same topic, our work uses different methodology from that in [I ■'] and requires less 
assumptions on the service time distribution. In our work, the only assumption on the service time 
distribution is continuity, while the service time distribution in [ I ">] is required to have a density and 
the hazard rate function must be either bounded or lower lower-semicontinuous. From the modeling 
aspect, our approach mainly based on tracking the "residual" processes, while [15] tracks the "age" 
processes for studying the queueing model. Also, we propose a quite simple fluid model, which 
facilitates the analysis. The existence of solution to the fluid model in [1 "j] is proved by showing 
each fluid limit satisfies the fluid model equations. The current paper proves the existence directly 
from the definition of the fluid model without invoking fluid limits. In addition, we verify in the 
end of this paper (c.f. Section 6) that our fluid model is consistent with the special case where both 
service and patience times are exponentially distributed, as established in Whitt [27] for the ED 
regime. Garnet et al. [7] for QED regime and Pang and Whitt [21] and Puhalskii [22] for all three 
regimes. Additional works on many-server queues with abandonment includes Dai, He and Tezcan 
[4] for phase-type service time distributions and exponential patience time distribution; Zeltyn and 
Mandelbaum [29] for exponential service time distribution and general patience time distributions; 
Mandelbaum and Momcilovic [19] for both general service time distribution and general patience 
time distribution. The difference between our work and [19] is that we study the fluid limit of 
measure- valued processes in all three regimes, and [19] studies the diffusion limit of customer count 
processes and virtual waiting processes in the QED regime. By assuming a convenient initial 
condition, [19] does not require a detailed fluid model analysis. 

The paper is organized as follows: We begin in Section 2 by formulating the mathematical model 
of the G/GI /n+GI queue. The dynamics of the system are clearly described by modeling with 
measure-valued processes; see (2.4) and (2.5). The main results, including a characterization of the 
fluid model and the convergence of the stochastic processes underlying the G/GI /n+GI queue to 
the fluid model solution are stated in Section 3. In Section 4, we explore the fluid model and give 
proofs of all the results on the fluid model. Section 5 is devoted to establishing the convergence of 
stochastic processes, which includes the proof of pre-compactness and the characterization of the 
limit as the fluid model solution. 

1.1 Notation 

The following notation will be used throughout. Let N, Z and M denote the set of natural numbers, 
integers and real numbers respectively. Let ]R_|_ = [0, cxa). For a,6 € M, write for the positive 
part of a, \a\ for the integer part, [a] for [aj aV6 for the maximum, and a/\b for the minimum. 
For any A C M, denote ^{A) the collection of all Borel subsets which are subsets of A. 

Let M denote the set of all non-negative finite Borel measures on M, and M+ denote the set of 
all non-negative finite Borel measures on (0, oo). To simplify the notation, let us take the convention 
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that for any Borel set ^4 C K, i^i^A D (— oo,0]) = for any € M-|_. Also, by this convention, M+ 
is embedded as a subspace of M. For j^i, 1^2 G M, the Prohorov metric is defined to be 

d[ui,i^2] = inf |e > : ui{A) < z^2(^^) + e and 

U2{A) <ui{A'') + € for ah closed Borel set ^ C m|, 

where = {6 € M : inf^g^ 1^^ ~ ^1 < This is the metric that induces the topology of weak 
convergence of finite Borel measures. (See Section 6 in [1].) For any Borel measurable function 
(7 : M — > R, the integration of this function with respect to the measure 1/ G M is denoted by {g, v). 

Let M_|_ X M denote the Cartesian product. There are a number of ways to define the metric 
on the product space. For convenience we define the metric to be the maximum of the Prohorov 
metric between each component. With a little abuse of notation, we still use d to denote this 
metric. 

Let (E, vr) be a general metric space. We consider the space D of all right-continuous E-valued 
functions with finite left limits defined either on a finite interval [0, T] or the infinite interval [0, 00). 
We refer to the space as D([0, T],E) or D([0,cx)),E) depending upon the function domain. The 
space D is also known as the space of cadlag functions. For g{-),g'{ ) G D([0,T],E), the uniform 
metric is defined as 

VT[g,g'] = sup ^[g{t),g'{t)]. (1.1) 

0<t<T 

However, a more useful metric we will use is the following Skorohod J\ metric, 

QT[g,g'] = inf (11/11?^ Vt;T[5,5'o/]), (1-2) 

where g o /(t) = g{f{t)) for t > and A^^ is the set of strictly increasing and continuous mapping 
of [0, T] onto itself and 

/W -/(«), 



I/IIt= sup log- 



0<s<t<T 



t - S 



If g{-) and g'{-) are in the space D([0, 00), E), the Skorohod Ji metric is defined as 

;>oo 

g[g,g'] = / {grig, g'] A l)dT. (1.3) 

Jo 

By saying convergence in the space D, we mean the convergence under the Skorohod Ji topology, 
which is the topology induced by the Skorohod Ji metric [5]. 

We use "— >" to denote the convergence in the metric space (E,7r), and use to denote the 
convergence in distribution of random variables taking value in the metric space (E,7r). 

2 Stochastic Model 

In this section, we first describe the G/GI /n+GI queueing system and then introduce a pair of 
measure-valued processes that capture the dynamics of the system. 
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There are n identical servers in the system. Customers arrive according to a general stationary 
arrival process (the initial G) with arrival rate A. Let denote the arrival time of the ith arriving 
customer, i = 1, 2, • • • . An arriving customer enters service immediately upon arrival if there is a 
server available. If all n servers are busy, the arriving customer waits in a buffer, which has infinite 
capacity. Customers are served in the order of their arrival by the first available server. Waiting 
customers may also elect to abandon. We assume that each customer has a random patience time. 
A customer will abandon immediately when his waiting time in the buffer exceeds his patience time. 
Once a customer starts his service, the customer remains until the service is completed. There are 
no retrials; abandoning customers leave without affecting future arrivals. 

The two GIs in the notation mean that the service times and patience times come from two 
independent sequences of iid random variables; these two sequences are assumed to be independent 
of the arrival process. Let Ui and Vi denote the patience and service time of the ith. arriving 
customer, i = 1,2,---. In many applications such as telephone call centers, customers cannot 
see the queue (the case of invisible queues, c.f. [20]), thus do not know the experience of other 
customers. In such a case, it is natural to assume that patience times are iid. Denote F{-) and 
G(-) the distributions for the patience and service times, respectively. 

To describe the system using measure-valued process, we first introduce the notion of virtual 
buffer. The virtual buffer holds all customers in the real buffer and some of the abandoned cus- 
tomers. An abandoned customer continues to wait in the virtual buffer when he first abandons until 
it were his turn for service had he not abandoned. At this time, he leaves the virtual buffer. At 
any time t >0, TZ{t) denotes a measure in M such that lZ{t){C) is the number of customers in the 
virtual buffer with remaining patience time in C G =^(R). Please note that this way of modeling 
requires TZ{-) to be a measure on M, not just (0, oo). It is clear that 



represent the number of customers waiting in the real buffer and number of customers in the virtual 
buffer, respectively. 

We also use a measure to describe the server. At any time t > 0, Z{t) denotes a measure 
in M_|_ such that Z[t){C) is the number of customers in service with remaining service time in 
C G =^((0, oo)). Different from the virtual buffer, the servers only hold customers with positive 
remaining service times, so we only care about the subsets in (0, oo). The quantity 



represents the number of customers in service at any time i > 0. 

The measure-valued (taking value in M x M+) stochastic process {TZ{-), Z{-)) serves as the 
descriptor for the G /GI /n+GI queueing model. Before we use it to describe the dynamics of the 



Q{t) = n{t){{0, oo)) and R{t) = n{t){R) 




Z(t) = Z(t)((0,oo)) 
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system, let us first talk about the initial condition, since the system is allowed to be non-empty 
initially. The initial state specifies R{0), the number of customers in the virtual buffer as well as 
their remaining patience times Ui and service times Vi, i = 1 — R{0),2 — R{0), ■ ■ ■ ,0. The initial 
state also specifies Z{0), the number of customers in service as well as their remaining service times 
Vi, i = 1 — R{0) — Z{0), ■ ■ ■ , —R{0). Briefly, the initial customers are given negative index, in order 
not to conflict with the index of arriving customers. Those initial customers in the buffer are also 
assumed to have i.i.d. service times with distribution G{-). For each t > 0, denote E(t) the number 
of customers that has arrived during time interval (0, t]. Arriving customers are indexed by 1, 2, • • • 
according to the order of their arrival. By this way of indexing customers, it is clear that the index 
of the first customer in the virtual buffer at time t > is B{t) + 1, where 



Denote Wi the waiting time of the ith customers; then = aj + Wi is the time when the ith. job 
starts service for alH > 1 — R{0). For i < 0, ai may be a negative number indicating how long the 
ith customer had been there by time 0. We will impose some conditions on Oj's with i < later on. 



C + x = {c + x:rcGC}for any subset C C M and Cx = {x, oo). For any subsets C, C C M, let 
C xC' denote the Cartesian product. Using the Dirac measure and the above introduced notations, 
the evolution of the system can be captured by the following stochastic dynamic equations: 



B{t) =E{t)-R{t). 



(2.3) 



Let 6x and denote the Dirac point measure at x G R and {x,y) € 



respectively. Denote 




m 

6u, {C + t-Oi), for all C e =^(M), 



(2.4) 



i=l+B(t) 
-RiO) 



Z{t){C) 



E K{c + t) 



i=l-R{0)-Z{Q) 
Bit) 



for all C G =^((0,oo)) 



(2.5) 



+ Yl '^K'''') + Ti-ai)x {C + t- Ti) 

i=l-fi(0) 



for all t > 0. Denote the total number of customers in the system by 



X{t) = Q{t) + Z{t) for all t > 0. 



The following policy constraints must be satisfied at any time t >0 



Q{t) = {X{t)-ny 
Z{t) = {X{t)An), 



+ 



(2.6) 
(2.7) 



where n, as introduced above, denotes the number of servers in the system. 
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3 Main Results 



The main results of this paper contains two parts. The first part is a characterization of the fluid 
model, including the existence and uniqueness of the fluid model solution, and the equilibrium of 
the fluid model; these results are summarized in Section 3.f . The second part is the convergence 
of the stochastic processes to the fluid model solution; this result is stated in Section 3.2. 

3.1 Fluid Model 

To study the stochastic model, we introduce a determinisitic fluid model. To simplify notations, 
let F^{-) denote the complement of the patience time distribution F{-), i.e. F'^{x) = 1 — F{x) for 
all X G M; the complement of the service time distribution, denoted by G'^(-), is defined in the same 
way. We introduce the following fluid dynamic equations: 



Jo 

where Cx = (x,oo) and B{s) = As — R{s). Here, all the time dependent quanities are assumed 
to be right continuous on [0, oo) and to have left limits in (0,oo); furthermore, B{-) is a non- 



on the interval (0, t]. The quantities R{-), Q{-), Z{-) and X{-) are defined in the same way as their 
stochastic counterparts in (2.1), (2.2) and (2). The following policy constraints must be satisfied 
for all t > 0, 



The fluid dynamic equations (3.1) and (3.2) and the policy constraints (3.3) and (3.4) define a fluid 
model, which is denoted by {X,F,G). 

Denote (TZqjZq) = {TZ{0),Z{0)) the initial condition of the fiuid model. For the convenience 
of notations, also denote Qq = Q{0), Zq = Z{0) and Xq = Oo + Zq. We need to require that the 
initial condition satisfies the dynamic equations and the policy constraints, i.e. 




decreasing function, and the integral Jq g{s) dB{s) is interpreted as the Lebesgue-Stieltjes integral 



Q{t) = {x{t) - ly 

Z{t) = iX{t)Al). 



+ 



(3.3) 
(3.4) 




(3.5) 



go 



(^0 - !)■ 
(Xo Al). 



+ 



(3.6) 
(3.7) 



Zo 
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We also require that 

^o({0}) = 0, (3.8) 

which means that nobody with remaining service time stays in the server. We caU any element 
(7^0) ^o) G M X a valid initial condition if it satisfies (3.5)-(3.8). 

We caU {1Z{-),Z{-)) e D([0,oo),M x M+) a solution to the fluid model (A,F,G) with a valid 
initial condition ("^Oj-^o) if it satisfies the fluid dynamic equations (3.1) and (3.2) and the policy 
constraints (3.3) and (3.4). 

Denote fi the reciprocal of first moment of the service time distribution G{-). Let 

Mf = inf{x > : F{x) = 1}. (3.9) 

By the right continuity, it is clear that F(x) < 1 for all x < Mp and F{x) = 1 for all x > Mp. 
If the patience time distribution F{-) has a density /(•), then define the hazard rate hp{-) of the 
distribution F{-) by 



1-F{x) 

x> Mp. 



hp{x) - 

Theorem 3.1 (Existence and Uniqueness). Assume the service time distribution satisfies both that 

G(-) is continuous, (3.10) 

and that 

0<fi<oo. (3.11) 
Assume the patience time distribution satisfies either that 

F{-) is Lipschitz continuous, (3.12) 

or that F{-) has a density /(•) such that the hazard rate is bounded, i.e. 

sup hp{x) < oo. (3.13) 

a;S[0,oo) 

There exists a unique solution to the fluid model {X,F,G) for any valid initial condition {TZq,Zo). 

The above theorem provides the foundation to further study the fluid model. A key property 
is that the fluid model has an equilibrium state. An equilibrium state is defined as the following: 

Definition 3.1. An element (TZocZoo) G M x M+ is called an equilibrium state for the fluid 
model {X,F,G) if the solution to the fluid model with initial condition {JZo^^Z^) satisfies 

{1Z{t),Z{t)) = {Hoc, Z^) for all t > 0. 
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This definition says that if a fluid model solution starts from an equilibrium state, it will never 
change in the future. To present the result about equilibrium state, we need to introduce some 
more notation. For the service time distribution function G{-) on M4., the associated equilibrium 
distribution is given by 

rx 

Ge{x) = fi G''{y)dy, for all x>0. 
Jo 

Theorem 3.2. Assume the conditions in Theorem 3.1. The state (IZoo, ^00) is an equilibrium state 
of the fluid model (A, F, G) if and only if it satisfies 

1^oo{Gx) = X F''{x + s)ds, xGR, (3.14) 
Jo 

Joo(a) =min(p,l)[l-Ge(x)], xG(0,oo), (3.15) 
where w is a solution to the equation 



F{w) = max 




(3.16) 



Remark 3.1. If equation (3.16) has multiple solutions, then the equilibrium is not unique (any 
solution w gives an equilibrium). If the equation has a unique solution (for example when F{-) is 
strictly increasing), then the equilibrium state is unique. 

The quantity w is interpreted to be the offered waiting time for an arriving customer. If his 
patience time exceeds w, he will not abandon. Thus, the probabilty of his abandonment is given 
by F(w), which is equal to {p — l)/p when p > 1; the latter quantity is the fraction of traffic that 
has to be discarded due to the overloading. From (3.14), TZoo{Cx) = Au; for x < —w. Thus, the 
average number of customers in the virtual buffer is 

i?oo = ^oo(K) = Aw, 

which is consistent with the Little's law. From (3.15), the average number of busy servers is 

Zoo = 2oo{{0, 00)) = min(/3, 1), 

which is intuitively clear. These observations and interpretations were first made by Whitt [28], 
where approximation formulas based on a conjectured fluid model were also given, and were com- 
pared with extensive simulation results. The approximation formulas derived from our fluid model 
is consistent with those formulas in Whitt [28]. 

3.2 Convergence of Stochastic Models 

We consider a sequence of queueing systems indexed by the number of servers n, with n — > 00. 
Each model is defined in the same way as in Section 2. The arrival rate of each model is assumed 
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be to proportional to n. To distinguish models with different indices, quantities of the nth model 
are accompanied with superscript n. Each model may be defined on a different probability space 
(fi", .F", P"). Our results concern the asymptotic behavior of the descriptors under the fluid scaling, 
which is defined by 

= -Tr{t), = -z'^it), (3.17) 

n n 

for all t >0. The fluid scaling for the arrival process is defined in the same way, i.e. 

n 

for all t > 0. We assume that 

^'^(.)^A- asn^oo. (3.18) 

Since the limit is deterministic, the convergence in distribution in (3.18) is equivalent to convergence 
in probability; namely, for each T > and each e > 0, 

lim P"f sup lE^'it) - Xt\ > = 0. 

n~>oo \o<t<T ' 

Denote v"^ and v'q the probability measures corresponding to the patience time distribution 
and the service time distribution G", respectively. Assume that as — > oo, 

where vp and vq are some probability measures with associated distribution functions F and G. 
Also, the following initial condition will be assumed: 

(:^"(0), 2"(0)) ^ (:R.o, ^o) as n ^ oo, (3.20) 

where, almost surely, (T^Oi^o) is a valid initial condition and 

TLq and has no atoms. (3.21) 

Theorem 3.3. In addition to the assumptions (3. 10) -(3. 13) in Theorem 3.1, if the sequence of 
many-server queues satisfies (3.18)^(3.21), then 

{n^{-),Z^{-))^{n{-),Z{-)) asn^oo, 

where, almost surely, {1Z{-),Z{-)) is the unique solution to the fluid model {X,F,G) with initial 
condition {1Zq,Zq). 

4 Properties of the Fluid Model 

In this section, we analyze the proposed fluid model and establish some basic properties of the fluid 
model solution. The proof of Theorem 3.1 for existence and uniqueness and the proof of Theorem 3.2 
for characterization of the equilibrium will be presented in Section 4.1 and Section 4.2, respectively. 



11 



4.1 Existence and Uniqueness of Fluid Model Solutions 

We first present some calculus on the fluid dynamic equations (3.1) and (3.2), which define the 
fluid model. It follows from (3.1) that 

Q(t) = 1Zit){Co) = A / F^it - s)d.s = X I F''{s)ds. 
Jt~^ Jo 



Let 



Fa{x) = [ [1- F{y)]dy for all x > 0. 
Jo 



Please note that the density of i^f;(-) is not scaled by the mean of F{-). Thus, this is not exactly 
the equihbrium distribution associated with F[-). In fact, we do not need the mean 

Nf= / [l-F{y)]dy (4.1) 
Jo 

to be finite. Now we have 

It follows from (3.2) that 

Z{t) = m{Co) = ^o(Co + t) + \f F\^)G\t - s)ds 

Jo ^ 

- I^F^{^)G^{t-s)dR{s). 

Note that by (4.2), dQ{s) = F''{^)dR{s). So 

Z{t) = ZoiCo + *) + -/* F'{^)dGe{t -s)- f G\t - s)dQ{s). 

Jo X Jo 

Performing change of variable and integration by parts, we have 

Z{t) = ZoiCt) + - f F% ^^^~'^ )dGe{s) 
Jo ^ 

-Qit)G%0) + Q{0)G^{t)+ [ Q{t-s)dG{s). 

Jo 



(4.3) 



we wish to represent the term F'^{—y^) using Q{-)- Recall Mp and Np, which are defined in (3.9) 
and (4.1), respectively. It is clear that -F(i(x) is strictly monotone for x G [0,Mf). Thus, F^^{y) is 
well defined for each y G [0, Np). We define F^^{y) = Mp for all y > Np. Thus, (4.2) implies that 

^c(M) = ,.c^^-i(M)). (4.4) 
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Note that G^(0) = 1 by assumption (3.10). Combining (3.3), (3.4), (4.3), and (4.4), we obtain 



X{t) = Z^{Ct) + QQG%t) 



+ [\x{t-s)-l)+dG{s) 
Jo 



Now, introduce 



H{x) 



F-(F-i(f)) ifO<x<A, 
ifx>A, 
and Co(-) = 2o{Co + •) + QoG^i-). It then follows that 



X{t) = Co{t) + P [ H{{X{t -s)- l)+)(iGe(s) + I {X{t -s)- l)+dG{s). (4.5) 
Jo Jo 

Please note that Co(') depends only on the initial condition and H{-) is a function defined by the 
arrival rate A and the patience time distribution F{-). The equation (4.5) serves as a key to the 
analysis of the fluid model. 

Proof of Theorem 3.1. We first prove the existence. Given a valid initial condition {JZq^Zq) (i.e. 
an element in M x that satisfies (3.5)- (3.8)), we now construct a solution {TZ{-), Z{-)) to the 
fluid model {X,F,G) with this initial condition. If the patience time distribution F{-) is Lipschitz 
continuous, then it is clear that H{-) is also Lipschitz continuous; if F{-) has a density, then the 
function H{-) is differentiable and has derivative 

= -/(y)^ = T^^T^ = -hF{y), 

on the interval (0, XNp) if y = F^^{x) and H{x) = for all x > XNp- By condition (3.13), 

sup \H'{x)\ = sup hpiil), 

0<x<\Nf y£[0,AlF) 

which implies that H{-) is Lipschitz continuous. It follows from Lemma A.l that the equation (4.5) 
has a unique solution X{-). Denote Q{t) = {X{t) — ■ We first claim that Q{t)/\ < Np for all 
t > 0. The claim is automatically true if Np = oo. Now, let us consider the case where Np < oo. 
Since {TZqjZq) is a vahd initial condition, Q{0)/X < Np. Suppose there exists ti > such that 
Q{ti)/X > Np. Let to = sup{s : Q{s)/X < Np, s < ti}. So we have that limt^to Qif)/^ ^ -^F, since 
Q{-) has left limit. Let 5 = (Q(ti)/A - Np)/A and pick ts G [to - <5, to] such that Q{ts)/X <Np + 6. 
By Lemma A. 2, 

0p_M<|'V.,^^-.(5M„,, ,4..) 
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for any t < t'. This gives that 

f-to rh 
< Nf + S+ lds+ Ods 

Jts J to 

which is a contradiction. This proves the claim. Let 



Z{t) =min(X(t),l), 

R{t) = ^F-\91^l 

B{t) = \t- R{t), 

for ah t > 0. Next, we claim that the process B{-) is non-decreasing. To prove this claim, it is 
enough show that 

F,-H^)-F,^\^)<t'-t (4.7) 

for any t < t'. Since F^^ is a non-decreasing function, the inequality holds trivially when Q{t') < 
Q{t). We now focus on the case where Q{t') > Q{t). Note that the function F^^{-) is convex, since 
the derivative is non-decreasing. This together with (4.6) implies that 

If Q{t) < Q{s) for all s G [t,t'], then due to the fact that F^{F^^ {■)) is non-increasing, we have 

<F-i(M)+t'_t. 

which gives (4.7); otherwise, let t* G it,t') be the point where Q{-) achieves minimum. Since 
Q{t) > Q{t*), we have 

Since Q{t*) < Q{s) for all s £ by the same reasoning in the above, we also have 

The above two inequalities also leads to (4.7). So the claim is proved. We now construct a fluid 
model solution by letting 

1Z{t){C^) = X I _^ F^{x + t-s)ds, 

Z{t)iC,) = Zoic + + F%^)G%x + t - s)dB{s), 
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for all t > 0. It is clear that the above defined ('R.{-) , Z {■)) satisfies the fluid dynamic equations 
(3.1) and (3.2) and constraints (3.3) and (3.4). So we conclude that (JZ{-),Z(-)) is a fluid model 
solution. 

It now remains to show the uniqueness. Suppose there is another solution to the fluid model 
{X,F,G) with initial condition {1Zo,Zq), denoted by {TZ'^ {■), Z"^ {■)). Similarly, denote 

Zt(t) = Jt((o,oo)), 

for all t > 0. It must satisfy the fluid dynamic equations (3.1) and (3.2) and constraints (3.3) and 
(3.4). For ah t > 0, let 

According to the algebra at the beginning of Section 4.1, X^{-) must also satisfy equation (4.5). 
By the uniqueness of the solution to the equation (4.5) in Lemma A.l, 

X\t)=X{t) forant>0. 

This implies that R^{t) = R{t). By the dynamic equations (3.1) and (3.2), we must have that 

{lV{t),Z\t)) = {n{t),Z{t)) for ah t > 0. 

This completes the proof. □ 

4.2 Equilibrium State of the Fluid Model Solution 

In this section, we first intuitively explain what an equilibrium should be. Then we rigorously prove 
it in Theorem 3.2. To provide some intuition, note that in the equilibrium, by equation (3.1), one 
should have 

^oo(Cx) = A/ F'{x + s)ds, 
Jo 

for the buffer. This immediately implies that 

1loo{C.) = X[Fd{x + ^) - Fdi^)]- 

So the rate at which customers leave the buffer due to abandonment is: 

TZoo{Co) — TZooiCx) . ,RoO^ 

hm = AF(— ). 

x^o X A 

In the equilibrium, intuitively, the number of customers in service should not change and the 
distribution for the remaining service time should be the equilibrium distribution Ge(-), i.e. 
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The rate at which customers depart from the server is: 

hm = Zoo/U. 

The arrival rate must be equal to the summation of the departure rate from server (due to service 
completion) and the one from buffer (due to abandonment), i.e. 

A = \F{^) + Zoo^. (4.8) 



It follows directly from (4.2) that 

Qoo = AF,(%). (4.9) 



If Roo > 0, then according to (4.9) we have Qoo > 0. Thus = 1 according to policy constraints. 
By (4.8), p > 1 and is a solution to the equation F{w) = If -Roo = 0, then according to 
(4.8) we have p = Zoo < 1. In summary, we have that 

Qoo = AFrf(u;), 
Zoo = min(p, 1), 

where w is a solution to the equation F{w) = max(^^, 0). This is consistent with the one in [2S], 
which is derived from a conjecture of a fluid model. Now, we rigorously prove this result. 

Proof of Theorem 3.2. If [TZoo^Zoo) is an equilibrium state, then according to the definition, it 
must satisfies 

Tloo{Cx)=xf _ F''{x + t-s)ds, t>0, (4.10) 

Zoo{Cx) = Zoo{Cx + t)+ f F'{^)G'{x + t-s)d\s, t>0. (4.11) 

Jo 

It follows from (4.11) that 

ZooiCx) - ZooiCx + t) = pF'{^)ii f C'ix + t - s)ds 

A Jo 

= pF'{^)[Ge{x + t)-Ge{x)], t>0. 



Taking t — s- oo, one has 



Zoo{Cx) = pF%^)Gl{x). (4.12) 



Thus Zoo = pF^'i^). According to (4.2), we have that 

Qoo = AF,(^) 
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First assume that Roo > 0. Then Qoo > 0, and thus Z^o = 1 by the pohcy constraints (3.3) 
and (3.4). Therefore, pF^(^^) = 1, which imphes that F{^^) = and p > 1. Now assume 
that = 0. Then Z^q = p, which must be less than or equal to 1 by the policy constraints. 
Summarizing the cases where p > 1 and p < 1, we have that the equilibrium state must satisfy 
(3.14)-(3.16). 

If a state (^oo-^oo) satisfies (3.14)-(3.16), then let 

{n{t),z{t)) = {n^,z^), 

for aU t>0. If /9 < 1, then 1Z{-) = and Z(-) = p; if p > 1, then R{-) = Xw and Z(-) = 1, where 
ti; is a solution to equation (3.16). It is easy to check that {'R{-),Z{-)) is a fluid model solution in 
both cases. So by definition, the state {1Zoo,Zoo) is a equilibrium state. □ 



5 Fluid Approximation of the Stochastic Models 

Similar to (2.3), let 

5"(t) = ^"(i) -i?"(t). (5.1) 
It follows from (2.4) and (2.5) that the dynamics for the fluid scaled processes can be written as 

1V'{t){C) = - y <5„n(C + 1 - a"), for ah C G ^{R), (5.2) 

i=B"{t)+l 

^"(t)(C7) = ^"(s)(C + t-s) 

1 for all C7 e ^((0,oo)), (5.3) 

+ - E huf,vT)(Co + rr-a^)x{C + t-rn, 

i=B"{s)+l 

for all < s < t. 



5.1 Precompactness 

We first establish the following precompactness for the sequence of fluid scaled stochastic processes 
{(^"(•),Jn-))}- 

Theorem 5.1. Assume (3.18)-(3.21). The sequence of the fluid scaled stochastic processes {{1Z^{-),Z'^{-))}m&^ 
is precompact as n —>■ oo; namely, for each subsequence K'^"* (•), (•))}„^ with Uk oo, there 
exists a further subsequence {('R."*-' (■),^"''j (•))}nfc. such that 

(^% (.),^% (.)) => {n{-),Z{-)) as j ^ oo, 

for some {TZi-) , Z {■)) G D([0, c3o), M x M+). 
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The remaining of this section is devoted to proving the above theorem. By Theorem 3.7.2 in 
[5], it suffices to verify (a) the compact containment property, Lemma 5.1 and (6) the oscihation 
bomid, Lemma 5.4 below. 

5.1.1 Compact Containment 

A set K C M is relatively compact if sup^gK;C(^^) < oo, and there exists a sequence of nested 
compact sets Aj C M such that UAj = M and 

lim sup^(^^) = 0, 

where A'^ denotes the complement of Aj; see [14], Theorem A7.5. The first major step to prove 
Theorem 5.1 is to establish the following compact containment property. 

Lemma 5.1. Assume (3.18)-(3.21). Fix T > 0. For each r] > there exists a compact sei K C M 
such that 

liminfP"f(:^"(t), eKxK for allt£ [0,T]) >l-r]. 

To prove this result, we first need to establish some bound estimations. For the convenience of 
notation, denote E"'{s,t) = E^{t) — £"^{3) for any < s < t. Fix T > 0. It follows immediately 
from condition (3.18) that for each e > there exists an uq such that when n > no, 

P"f sup |^"(s,t)-A(t-s)| <e) > 1-e. (5.4) 

To facilitate some arguments later on, we derive the following result from the above inequality. 
Lemma 5.2. Fix T > 0. There exists a function eE{-), with lim„^oo ^Ein) = such that 
P"f sup \E''{s,t)-X{t-s)\<eE(,n))>l-eE{n), 

for each n > 0. 

The derivation of the above lemma from (5.4) follows the same as the proof of Lemma 5.1 in 
[31]. We omit the proof for brevity. Based on the above lemma, we construct the following event, 

= { sup |^"(s,t) - \(t - s)\ < esin)}. (5.5) 

te[o,T] 

We have that on this event, the arrival process is regular, i.e. E^{s,t) is "close" to \{t — s). And 
this event has "large" probability, i.e. 

\im¥''(n%) =1. (5.6) 
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Proof of Lemma 5.1. By the convergence of the initial condition (3.20), for any e > 0, there exists 
a relatively compact set Kq C M such that 

liminf P"f:^"(0) e Ko and Z"(0) G Kq) > 1 - e. (5.7) 

Denote the event in the above probability by On this event, by the definition of relatively 
compact set in the space M, there exists a function ko{-) with lim^j^oo f^oix) = such that 

^"(0)(C,.) < Ko{x), Z^mC,) < Ko{x), (5.8) 

and 

^"(0)(C-) < Ko{x), (5.9) 

for all a; > 0, where C~ = (— oo, —x) for any y € M. (Remember that ^"(0) is a measure on (0, oo), 
so we do not need to consider its measure of C~ .) It is clear that on the event H Oq, for any 
t <T and all large n, 

^"(t)(M) < sup:^"(0)(M) + 2Ar, 

n 

Z"(t)((0,oo))<l, 

where the last inequality is due to the fact that ^"(•) < n. Again, by the definition of relative 
compact set in M, we have that sup„ 7^"'(0)(M) = Mq < oo. It follows from the dynamic equation 
(5.2) and (5.3) that for ah x > 0, 

^"(t)(Cx) < ^"(o)(c,) + '^<(Cx), 

i=l 

^"(t)(c,) < z^mc^) + - E '^-"(^-)- 

Denote ;C"(t) = ;^ X^^i*'' and ;C2(i) = ;^ Xl^i*^ "^ff- Let us first study these two terms. Recall 
the definition of the event Q.'qq{M,L) and the envelope function / (which increases to infinity) 
in (B.7). For the application here, it is enough to set M = 1 and L = 2XT. On the event 
n n^ci^I, L), we have 

2XTn 



if, cut)) < if, - <5<) < 2XT{f, vf) + 1, 



n 

i=l 

for all large enough n. Similarly, on the same event we have that 

2\Tn 

n 



2XTn 

{f,^{t)) < if,- V 6,^)<2XT{f,UG) + l, 



i=l 
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for all large enough n. Denote Mb = 2ATmax((/, up), (/> ^^g)) + 1- By Markov's inequality, for all 
X > (again, on the same event and for all large n) 

Cl{t){C,) < M,/fix), ai{t){C,) < M,/f{x). 

Unlike the measure Z{t) € M+, the measure TZ{t) € M. So we need to consider all the test set 
CjT = (— oo, — j;) for x > 0. The following inequality again follows from (5.2), 

E^{t) 

iz^{t){c~) < ivmc~+t) + Suf{c-+t). 

i=l 

Note that if we take x > T, then 6u2{C~ + 1) = 0. So we have that 

^"(t)(C-) < ^"(0)(C- + T) = ^"(0)(C-_^), for all t < T. (5.10) 
Now, define the set K C M by 

K = |e e M :C(IR) < 1 + Mo + 2XT, 

£.iCcc) < noix) + Mb/ fix) for all x > 0, 
C{C~) < Ko{x - T) for ah x > t}. 
It is clear that K is relatively compact and on the event fl ^qq{M, L) n J^q , 

{n''{t),Z''{t)) G K X K for alH G [0,T]. 
The result of this lemma then follows immediately from (5.6), (5.7) and (B.8). □ 

5.1.2 Oscillation Bound 

The second major step to prove precompactness is to obtain the oscillation bound in Lemma 5.4 
below. The oscillation of a cadlag function C,{-) (taking values in a metric space (E,7r)) on a fixed 
interval [0, T] is defined as 

wt(C(-),<5)= sup ^[C(s),C(t)]- 

s,iG[0,T],|s-i|<<5 

If the metric space is M, we just use the Euclidean metric; if the space is M or M+, we use 
the Prohorov metric d defined in Section 1.1. For the measure- valued processes in our model, 
oscillations mainly result from sudden departures of a large number of customers. To control the 
departure process, we show that Z^{-) and TZ^{-) assign arbitrarily small mass to small intervals. 

Lemma 5.3. Assume (3.10), (3. 18) -(3.21). Fix T > 0. For each e,i] > there exists a k > 
( depending on e and t] ) such that 



liminf P" sup sup Z"(t)([x,x + k]) < e] > 1 - 77. (5.11) 
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Proof. First, We have that for any e, 77 > 0, there exists a k such that 

hminfP"f sup Z"(0)([3;,x + k]) < 6/2) > 1 - r?. (5.12) 

This inequality is derived from the initial condition. The derivation is exactly the same as in the 
proof of (5.14) in [.'M ], so we omit it here for brevity. 

Now we need to extend this result to the interval [0,T]. Denote the event in (5.12) by Oq, and 
the event in Lemma 5.1 by ^c(^)- Fix M = 1 and L = 2XT, Let 

!^^(M, L) = n'Sn !^J(K) n n n'^ciM, l). (5.13) 

By (5.12), Lemma 5.1, (5.6) and (B.8), for any fixed M, L > 0, 

lim inf P"f SI? (M,L)') > 1 - r?. 

n— >oo \ / 

In the remainder of the proof, all random objects are evaluated at a fixed sample path in r2"(M, L). 
It follows from the fluid scaled stochastic dynamic equation (5.3) that 

Z''(t){[x,x + K\) < Z''{0){[x,x + K\+t) 

^ B{t) 
i=B(0)+l 

for each x, k G R+. By (5.12), the first term on the right hand side of the above equation is always 
upper bounded by e/2. Let S denote the second term on the right hand side of the preceding 
equation. Now it only remains to show that S < e/2. 

Let = to < ^1 < ■ ■ ■ < ^ J = ^ be a partition of the interval [0,t] such that — tj\ < 6 for 
all J = 0, • ■ ■ , J — 1, where 5 and N are to be chosen below. Write S as the summation 

j=0 i=B{tj)+l 

Recall that r" is the time that the ith job starts service, so on each sub-interval [tj,tj^i] those i's 
to be summed must satisfy tj < r" < tj+i. This implies that 

t — tj + l ^ t — Ti ^ t — tj. 

Then 

S<^2~ E Svn[[x + t - tj+i,x + t - tj + k]). 

j=0 ^ i=B[tj]+l 
By (5.1), we have for all j = 0, • • • , J — 1 

-i?"(0) < S"(tj) < ^"(T), 
< S"(tj+i) - B"(tj) < ^"(T) + i?"(0). 
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By Lemmas 5.1 and 5.2, R^^O) < Mq and E'^{T) < 2XT on rig,(K) n for some constant Mq. 
Take M = max(Mo, 2XT) and L = Mq + 2XT, it follows from the Glevenko-Cantelli estimate (B.7) 
that 

^ B"{t j+i) 

— ^ dvf{[x + t-tj + l,X + t-tj + K]) 



n 



e 



< [B''{tj+i) - B''{tj)j + t - tj+i,x + t-tj + K]) + —, 
for each j < J. By condition (3.19), for any £2 > 0, 

dK.'^G] < £2, 

for all large n. By the definition of Prohorov metric, we have 

+ t - tj + i,X + t - tj + k]) < UgHx + t - tj^i - e2,X + t -tj + K + €2]), 

for all large n. Since [x + t — tj+i — e2,x + t — tj + k, + €2] is a close interval with length less than 
K + 6 + 2e2, by condition (3.10), we can choose k, 6, €2 small enough such that 

e 



Thus, we conclude that 



U{[X + t - tj + i -e2,X + t-tj + K. + €2]) < 



S<S-[B-(T)-mm + l<^/2. 



This completes the proof. □ 

Lemma 5.4. Assume (3.10), (3.18)-(3.21). Fix T > 0. For each e,r/ > there exists a 6 > 
( depending on e and r] ) such that 

liminfP"fwT((^",^")(-),5) <3e)>l-7j. (5.14) 

n— >oo \ / 

Proof. Define 

(e,K) = | sup sup J"(t)([x,x + K]) < e|. 
^te[o,T]xm+ ^ 

By (5.6) and Lemma 5.3, for each e, 77 > there exists a k > such that 

liminfP"fen!^]^^g(e,K)) > 1 - r/. (5.15) 



On the event f^Rcg(^' '^)' have some control over the dynamics of the system. First, note 
that the number of customers (in the virtual buffer, including those who have abandoned but ought 
to get service if they did not) that enter the server during time interval (s, t] can be upper bounded 
by 

B^{s,t) < E^{s,t) + Z'''{s){[0,t - s]). 
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When t — s < min(^, k), by the definition of and f^Reg(^' '^)' have 

^"(s,t)<e (5.16) 
^"(s,t)<2e. (5.17) 

Second, by the dynamic equation (5.2), for any s < t and any set C € i^(M), 

^"(t)(C) - :^"(s)(C3^)) < 5"(s, t) + ^"(s, t) 

+ - E ['^<(^^+i-ar)-5.r(c''+^-«r)], 

1+B"(t) 

where is the a-enlargement of the set C as defined in Section 1.1. Note that when t — s < 3e, 
C + t — a" C C^"^ + s — a" for all i € Z, which implies that the second term in the above inequality 
is less than zero. By (5.16) and (5.17), 

^"(t)(C) -7l"(s)(C73^)) < 3e. 

By Property (ii) on page 72 in [1], we have 

d[:^"(t),:^"(s)] < 3e. (5.18) 

Finally, by the dynamic equation (5.3), 

Z"(t)(C) < Z^{s){C + t-s)) + B^{s, t). 

Note that when t — s < 2e, C + t — sC C^"^, where is the a-enlargement of the set C as defined 
in Section 1.1. By (5.17), we have 

J"(t)(C7) < J"(s)(C2^) + 2e. 
By Property (ii) on page 72 in [1], we have 

d[Z"(s),Z"(i)] < 2e. (5.19) 
The result of this lemma follows immediately from (5.15), (5.18) and (5.19). □ 

5.2 Convergence to the Fluid Model Solution 

We have established the precompactness in Theorem 5.1. So every subsequence of the fluid scaled 
processes has a further subsequence which converges to some limit. For simplicity of notations, we 
index the convergent subsequence again by n. So we have that 

{n''{-),Z''{-)) ^ {n{-),Z{-)) asn^oo. (5.20) 

By the oscillation bound in Lemma 5.4, the limit {TZ{-), Z{-)) is almost surely continuous. We have 
the following result that further characterizes the above limit. 
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Lemma 5.5. Assume (3.10)-(3.13) and (3.18)-(3.21). The limit {iZ{-),Z{-)) in (5.20) is almost 
surely the solution to the fluid model {X,F,G) with initial condition (TZoj^q). 

The rest of this section is devoted to characterizing the hmits. To better structure the proof, 
we first provide some prehminary estimates based on the dynamic equations (5.2) and (5.3). 

Lemma 5.6. Let {tj}j^Q be a partition of the interval [s,t] such that s = to < ti < . . . < tj = t. 

We have for any x € M, 

n"{t){C,)<^^ f2 Sun{C,+t-tj) + \E^{s)-B^{t)l (5.21) 

i=0 i=l+E"{tj) 

^"(t)(a)>j;- Yl 'Jn7(a+t-t,+i)-|^"(s)-5"(t)|. (5.22) 

i=0 i=l+E"(tj) 

If in addition that sup^g[^ \E'^{t) — At| < e, then for any x > 0, 
Z^mC,)<Z^{s)iC, + t-s) 



i^l """^^^^ ^£,-2e (5-23) 

+ E- E 5k((^o + ^^ )6,n(C, + t-tj), 

j=0 i=l+B^(tj) 



Z^{t){Ca.)>Z^{s){C^ + t-s 



■^^\ """^'^ ^?/,- + 2e (5-24) 

+ V- V 6ur^{Co + ^^^ )5^n{C^ + t-tj+l), 

i=0 i=l+B"{tj) 



where Rl j = init^^t^^t^^^] E^{t) and R^j - = sup^gf^ .^^^.^^j -R"(t). 

Proof. Note that < (5u^(C) < 1 for any Borel set C and any random variable u^. So by the 
dynamic equation (5.2), we have 

n-{t){C)-- Yl ^KiC + t-a^) <\E-is)-B-{t)\. 

j=_E"(s)+l 

For those z's such that E"'{tj) < i < £'"(tj+i), we have that 

tj < ar < tj+i- (5-25) 
This imphes that Cx + t — ai^Cx+t — tj. So we have 

Suf{Cx + t-ai)< Y 6u^{Cx + t -tj). 

This estabhshes (5.21). Also, (5.25) implies Cx + t — tj+i Q Cx + t — Oi. So (5.22) follows in the 
same way. 
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For those i's such that B'^{tj) < i < we have that 

tj < < tj+i. 



Note that -R"(rf) = E'^{t'^) — £'"(a") for each i. So, by the closeness between £'"(•) and A-, we 
have 

ii?>r)-A(rr-ani 

< |i2"(rf ) - ^"(rf ) + E-{a^)\ + |^"(rf ) - ^"(af) - A(rf - a^)\ 

< 2e. 

So 

i?£,,-2e<A(r;^-an<ii&,, + 26, 
for all i's such that B"-{tj) < i < Thus, 



i=l+B"{tj) i=l+B"{tj) 

This implies (5.23). And (5.24) can be proved in the same way. □ 

Recall the notations £"(m, l),£.p(m, I) and Cg{m, I) are defined in (B.1)-(B.3) in the appendix. 
Using these notations. Lemma 5.6 can be written as the following: 

Lemma 5.7. Let {tj}j^Q be a partition of the interval [s,t] such that s = to < ti < . . . < tj = t. 

We have for any x £W, 

J-i 

n^ma,) < Y,{hc.+t-t,),^;{E''{t,),E^{t„t,+i)) + \E^is) - B^it)\, (5.26) 
i=0 
J -I 

n^mC.) > Y.mc.+t.t,^,),C;{E^t,),E^t„t,+,)) - \E-{s) - ^"(t)|. (5.27) 

i=0 

If in addition that sup^gj^^^j \E'^{t) — At| < e, then for any x > 0, 

z^it){a,)<z^{s){c, + t-s) 

Z^{t){C,)>Z^{s)iC, + t-s) 

+ C-{B-{t,),B-{t„t,_,,))). 



(5.28) 



(5.29) 
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Fix a constant T > and let M = 1 and L = 2AT. Denote the random variable 



X Cy) - lu^p{C^)u^{Cy)\ 
+ \C'p{m,l){C^)-lu^p{C^)\ ). (5.30) 

^ +\Cl{m,l){a,)-ly'^{C^)\ 

By Lemma B.l, for any fixed constants M, L > 0, 



Vm,l = max sup sup < 

-nAf<m<nM,£[0,L] x,y& 



^M,L ^0 as n ^ OO. 

By the assumption (3.18), we have 

£■"■(■) ^ A ■ as n ^ oo. 

Since both the above two limits are deterministic, those convergences are joint with the convergence 
of ('R,"(-), ^"(•)). Now, for each n > 1, we can view {E'^{-),'R'^{-), Z'^{-),Vm,l) as a random variable 
in the space Ei, which is the product space of three D([0,oo),]R) spaces and the space M. And 
{C^{m, ■), C^{m, ■), CQ{m, ■) : m G Z) in the product space E2 of countable many D([0,oo),M) 
spaces. It is clear that both Ei and E2 are complete and separable metric spaces. Using the 
extension of Skorohod representation Theorem, Lemma C.l, we assume without loss of generality 
that E''{-),n'^{-),Z'^{-),V^j j^,C'^{m,-),C],{m,-),C'^{m,-),m € Z, and (7^(•),i(•)) are defined on 
a common probability space {0,,J^,¥) such that, almost surely, 

(^"(•),^"(.)),Vr/,z.,^"(-)) - ((^(•),^(-)),0,A-) asn^oo, (5.31) 

and inequalities (5.26)-(5.29) and equation (5.30) also hold almost surely. Note that the conver- 
gence of each function component in the above is in the Skorohod Ji topology. Since the limit 
is continuous, the convergence is equivalent to the convergence in the uniform norm on compact 
intervals. Thus as n — > 00, 

sup d[-^"(t),:^(i)] ^ 0, (5.32) 
te[o,T] 

sup d[Z"(t),Z(t)] ^0, (5.33) 
te[o,T] 

sup |^"(t) - At| ^ 0, (5.34) 

tG[0,T] 

where d is the Skorohod metric defined in Section 1.1. Same as on the original probability space, 
let 

Z"(.) = (l,2"(.)), X"(.) = Q"(-) + ^"(-), 

and 

^^(.) = E"(-) - i2"(-)- 
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According to (5.32) and (5.34), we have 

sup |B"(t) - B{t)\ 0. (5.35) 
te[o,T] 

For each n, let ^n,2 be an event of probability one on which the stochastic dynamic equations 
(5.2) and (5.3) and the policy constraints (2.6) and (2.7) hold. Define = f^i n (nj^g^n 2)' where 
0,1 is the event of probability one on which (5.31) holds. Then ^Iq also has probability one. Based 
on Lemma 5.6 and the above argument using Skorohod Representation theorem, we can now prove 
Lemma 5.5. 

Proof of Lemma 5.5. For any t > 0, fix a constant T > t. Let us now study (JZ{-),Z{-)) on the 
time interval [0, T]. It is enough to show that on the event Qq, (TZ{t),Z(t)) satisfies the fluid model 
equation (3.1)-(3.2) and the constraints (3.3)-(3.4). Assume for the remainder of this proof that 
all random objects are evaluated at a sample path in the event 0,q. 

We first verify (3.1). For any e > 0, consider the difference 
n{t){C^)- [ . F^{x + t-s)d\s 

= n{t){c.) - n'^mci) + ^"(t)(C|) - £^ F\x + 1 - s)dxs, 

where C| is the e-enlargement of the set Cx as defined in Section 1.1, which is essentially Cx-e- Let 
to = t — R{t)/X. According to (5.26), we have that 

ft 



■R{t){Cx)- [ - F^{x + t- s)dXs 



i=0 



< n{t){Cx) - n^mC'x) + l^"(io) - B-{t)\ (5.36) 
Y,{Mc^^+t-t,)X;iE-{t,),E-{t„t,+^))- / F'{x + t-s)dXs, 



where {tj}j^Q is a partition of the interval [to,t] such that to < < • • • < * J = ^ and maxj(tj_|_i — 
tj) < 6 for some 5 > 0. By the definition of Prohorov metric and the convergence in (5.32), the 
first term on the right hand side of (5.36) is bounded by e for all large n. By (5.32) and (5.34) 

\B^{t) - E^{to)\ = \E^{t) - R^{t) - E^{to)\ 

< |^"(t) - Xt\ + |i?"(t) - R{t)\ + |S"(to) - Xto\ < 3e, 

for all large n. So 

n{t){Cx)- I , F'^ix + t- s)dXs 

. (5-37) 

<^e + Y,{\c^^+t-t,),£-';{E^{h),E^{h,t,^i))- / F'{x + t-s)dXs, 
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for all large n. Similarly, according to (5.27), we have 



7^(^)(c, 



R{t) 



F%x + t- s)dXs 



i=0 -^^0 



(5.38) 



for all large n. Note that for each j, we have 

< (l(c,+,„,^,), £^(i?"(t,), Kh+i - + 2e) 

< [\{tj+i - tj) + 2e]i/^(C| + t-tj) + e 

< [\{tj+i - tj) + 2e] [uf{C^ + t-tj)+e]+e 

< X{tj+i - tj)uF{Cx + t - tj) + (3 + X5)e 

for all large n, where the first inequality is due to (5.34), the second one is due to (5.31) (the 
component of V^j i), the third one is due to (3.19), and the last one is due to algebra. Similarly, 
we can show that 



(l(c,+i-ij+i)''^p(^"(*j)'-^"(*i'*i+i)) 
> X{tj+i - tj)i^F{Ccc + t - tj+i) - (3 + X6)e 



for all large n. Note that X^jLo H^j+i - tj)F''{x + t - tj) and X;^=o H^j+i - tj)F''{x + t - tj+i) 
serve as the upper and lower Reimann sum of the integral J^* F'^{x + t — s)dXs, which converge to 
the integration as n ^ oo. So by (5.37) and (5.38), we have that for all large n, 



J-i 



\nt){c. 



F%x + t - s)dXs\ < (3 + X5)Je + 5e. 



We conclude that n{t){Cx) - F''{x + t - s)dXs = since e in the above can be arbitrary. 

This verifies (3.1). 

Next, we verify (3.2). For any e > 0, consider the difference 



Z{t){C^) - Zo{a, + t)- / * F^{?^)G%x + t - s)d[Xs - R{s)] 





A 



< \z{t){c.,) - z^{t){ci)\ + \z,{c, + t)- z^mci + t)\ 



(5.39) 



+ 



Z-{t){Cl) - Z^mCl +t)- f F\^)G\x + t - s)d[Xs - R{s)] 



where the above inequality is due to the fluid scaled stochastic dynamic equation (5.3). Again, by 
the definition of Prohorov metric and the convergence in (5.33), each of the first two terms on the 
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right hand side in the above inequaHty is less than e for all large n. Let {tjj^^Q be a partition of 
the interval [0, t] such that Q = < ti < . . . < tj = t and maxj(tj+i — tj) < 6 for some 5 > 0. Let 

Ru,j = sup R{t), Rlj = inf Rit). 

t€ltj,tj + i] *G[tj,tj + i] 

By (5.32), we have that 

for all large n. So for each j, we have 

< - B((j) + 2e]rll(C„ + )„g(Cl + ( - tj) + e 

< lB{tj+,) - B{tj) + 2t]\i.F{Co + ^) + jllfoCa + t-tj)+t]+t 

for all large n, where the first inequality is due to (5.35), the second one is due to (5.31) (the 
component of V^^^), the third one is due to (3.19). Let Mb be a finite upper bound oi B{tj)—B{to), 
the above inequality can be further bounded by 

[S(t,+i) - B{tj)]MCo + ^)MCx + t - tj) + + 2)MBe + 3e. 
Similarly, we can show that 

,„ , >'C"(B"(tj),-B"(tj,tj+i))) 

> [B{tj+i) - B{tj)]MC(^ + ^>g{C^ + t - tj) + 2)MBe - 3e. 

Note that Y.izl[B{h+i)-B{h)]F%^^)G%x + t-t,) and Y^j~l[B{tj+^) - B{t,)]F%^^)G%x + 
t — tj+i) serve as the upper and lower Reimann sum of the integral //^ F%^)G%x + 1 - s)dB{s), 
which converge to the integration as n ^ oo. So, by (5.28) and (5.29), we have that for all large n, 

Z"(t)(C|) - ^"(0)(C| + t)- f F'{^)G%x + t - s)dB{s) < (^ + 2)MBe + 3e + e. 

In summary, the right hand side of (5.39) can be bounded by a finite multiple of e. We conclude 
that the left hand side of (5.39) must be since it does not depend on e, which can be arbitrary. 
This verifies (3.2). 

The verification of fluid constrains (3.3) and (3.4) is quite straightforward. Basically, it is just 
passing the fluid scaled stochastic constraints 

Q^it) = {X^{t) - 1)+, 
Z"(t) = (X"(t) A 1), 

to n — > cx). We omit it for brevity. □ 
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6 The Special Case with Exponential Distribution 

In this section, we verify that the fluid model developed in this paper for the general patience and 
service time distributions is consistent with the one in [27], that was obtained in the special case 
where both distributions are assumed to be exponential. 

Our fluid model equations implies the key relationship (4.5). Now, we specialize in the case 
with exponential distribution, i.e. 

F{t) = Fe{t) = 1 - e""*, G{t) = Geit) = 1 - e"/^*, for all t > 0. 

Now (4.5) becomes 

X{t) = Co{t) +p [\l-^{{X{t-s)- l)+)]fie-^'ds + [\x{t -s)- l)+fie-^'ds. 
Jo Jo 

In the case of exponential service time distribution, the remaining service time of those initially in 

service and the service times of those initially waiting in queue are also assumed to be exponentially 

distributed. So we have 

Co{t) = MCo + t) + Qoe-^' = Xoe-^', 

where Xq = Zq + Qq is the initial number of customers in the system. By some algebra, the above 
two equations can be simplified as the following, 

X{t) = Xoe"^* + p[l - e-^*] + (^ - a) [\x{t - s) - l)+e-^''ds. (6.1) 

Jo 

By the change of variable t — s ^ s, the above integration can be written as 

/ {X{t - s) - l)+e-^'ds = e"^* / (X(s) - l)+e^^ds. 
Jo Jo 

Taking the derivative on both sides of (6.1) yields 

X'{t) = -fiXoe-^"^ + ^pe'^* 

+ (/i - a)[-/ie-^* [\x{s) - l)+e^^ds + e-^^Xit) - l)+e^*] 
Jo 

= -fiXoe-''^ - np[l - e^*] + fip 

- nifi - a)e-^* [\x{s) - l)+e^''ds + {p - a){X{t) - 1)+ 
Jo 

= -pX{t) +pp+{p- a){X{t) - 1)+. 

Using the notation in [27], a~ = — min(0, o) for any a € M. Note that a = min(a, 1) + (a — 1)^ = 
1 — (a — 1)~ + (o — 1)"*". So the above equation further implies 

X'{t) = p{p - 1) - a{X{t) - 1)+ + p{X{t) - 1)-, for all t > 0. 

This equation is consistent with Theorem 2.2 in [27] {p is assumed to be 1 in that paper). 
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A A Convolution Equation 

Lemma A.l. Assume that G{-) is a distribution function with G(0) < 1, C(') £ D([0,r],]R), H{-) 
is a Lipschitz continuous function, and /3 € M. There exists a unique solution x*{-) £ D([0,T],M) 
to the following equation: 

x{t) = C{t) + p [ H{{x{t-s)-l)+)dGe{s)+ [ {x{t- s) -l)+dG{s), (A.l) 
Jo Jo 

where, Ge is the equilibrium distribution of G as defined in Section 3.1. 

Proof. Suppose H{-) is Lipschitz continuous with constant L. The equilibruim distribution has 
density /u[l — G(-)], so \Ge{t) — Ge(s)| < p\t — s\ for any s,t € M. Since G(0) < 1, there exists 6 > 
such that 

K := pL[Ge{h) - Gem + [G{h) - G(0)] < 1. 

Now consider the space D([0,6],M) (all real valued cddldg functions on [0,6], c.f. Section 1.1) is 
a subset of the Banach space of bounded, measurable functions on [0,6], equipped with the sup 
norm. One can check that this subset is closed in the Banach space. Thus, the space D([0, 6],M) 
itself, equipped with the uniform metric vt (defined in Section 1.1), is complete. 

For any y G D([0,6],M), define "^{y) by 

^{y){t) = at) + p f H {{y{t -s)- 1)+) dGeis) + [\y{t - s) - l)+dG(s), 
Jo Jo 

for any t G [0,6]. By convention, the integration /q y(t — s)dF{s) is interpreted to be jj^ y{t — 
s)dF{s) (c.f. Page 43 in [:]]). We prove the existence and uniqueness of the solution to equation (A.l) 
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by showing that ^' is a contraction mapping on D([0, 6], M). According to the proof of Lemma A.l 
in [31], the convolution of a cadlag function with a distribution function is still a cadlag function. So 
^ is a mapping from D([0, 6], M) to D([0, 6], M). Next, we show that the mapping ^' is a contraction. 
For any y,y' G D([0, 6],M), we have that 

< sup p [' L\{y{t-s)-l)+ -{y'{u-v)-l)+\dGe{s) 



te[o,b] Jo 

+ sup f\{y{t -s)- 1)+ - {y'{t -s)- l)+\dG{s) 

t€[0,b] Jo 

/•b j-b 

<pL Vb[y,y']dGeis)+ vt,[y,y']dG{s) 
Jo Jo 

< K'Vb[y,y']. 

Since k < 1, the mapping ^' is a contraction. By the contraction mapping theorem (c.f. Theorem 3.2 
in [12]), has a unique fixed point x, i.e. x = ip{x). This implies that x € D([0, 6], M) is the unique 
solution to equation (A.l) on [0,6]. 

It now remains to extend the existence and uniqueness result from [0,6] to [0, T]. Denote 
Xbit) = x{b+t), (bit) = Cib+t)+p /,^+* H {{x{b + t-s)- 1)+) dGeis) + Jl;^\x{b+t-s)-l)+dGis), 
then we have for t £ [0, T — 6], 

xb{t) = Cbit) + P f H {{xb{t -s)- 1)+) dGe{s) + Axb(t -s)- l)+dG{s). (A.2) 
Jo Jo 

It follows from the previous argument that there is unique solution Xf,(-) to the above equation. 
Thus, we obtain a unique extension of the solution to (A.l) on the interval [0,26]. Repeating this 
approach for time with N > [T/6] gives a unique solution on the interval [0,T]. □ 

Lemma A.2. Assume the same condition as in Lemma A.l. Let x{-) € D([0,T],M) be the solution 
to equation (A.l). If p = X/ p with X, p > (p is the mean of G) , H{x) > for all x > 0, and 
({■) satisfies the following condition 

C(t) = Mi) + (C(0)-l)+[l-G(t)], (A.3) 

where h{-) is a non-increasing function, then the function 

{x{t) - 1)+ - A / H ((x(s) - 1)+) ds 







is non-increasing on the interval [0,r]. 

Proof. To simplify the notation, let Q{t) = (x(t) — 1)"^ and 

D{t) = Q{t) -X I H {Q{s)) ds (A.4) 
Jo 
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for all t € [0, T]. Since Ge(-) is the equilibrium distribution, we have 

x{t) = C{t)+p [ H (Qit - sj) fi[l - G{s)]ds + [ Q{t-s)dG{s) 
Jo Jo 

= C{t) + x[ H{Q{s))ds-X [ H{Q{s))G{t-s)ds+ [ Q{t-s)dG{s). 
Jo Jo Jo 

Applying Fubini's Theorem (c.f. Theorem 8.4 in [17]) to the second to the last integral in the above, 
we have 

ft ft ft — S 

/ H{Q{s))G{t-s)ds= / / H {Q{s)) dG{T)ds 
Jo Jo Jo 

t rt-T 

H{Q{s))dsdG{T). 



dG{s) 



Jo 

So we obtain 

x{t) -X [ H (Q(s)) ds = C{t) + / \Q{t -s)-X [ H {Q{t)) dr 
Jo Jo I Jo 

According to the above definition of -D(-), we have 

{x{t)Al) + D{t) = C{t)+[ D{t-s)dG{s). (A.5) 

Jo 

It now remains to use (A.5) to show that D{-) is non-increasing, i.e. for any t,t' G [0,T] with 
t < t' , we have D(t) > D{t'). Since G(0) < 1, there exists a > such that G{a) < 1. We first show 
that D[-) is non-increasing on the interval [0,a]. Let 

D* = sup D{t')-D{t). 

{(t,t')&[0,a]x[0,a]:t<t'} 

Since D{-) is cddldg, according to Theorem 6.2.2 in the supplement of [20], it is bounded on the 
interval [0,a]. Thus, D* is finite. We will prove by contradiction that D* < 0, which shows that 
D{-) is non-increasing on [0, a]. Assume on the contrary that D* > 0. Applying (A.5), we have 

D{t') - D{t) = {x{t) A 1) - (x(t') A 1) + at') - m 

l-t' 



+ [ D{t' - s)dG{s) - [ D{t- s)dG{s) 
Jo Jo 

(x(t) Al)-(x(0 Al)+C(0-C(t) 

+ [ D{t' - s)dG{s) + [ [D{t' -s)-D{t-s)]dGis). 
Jt Jo 



It follows from (A.l) and (A. 4) that D{0) = (C(0) — 1)^. This together with condition (A. 3) implies 
that 

at') - at) = hit') - h{t) + D{0)[G{t) - G{t')]. (A.6) 
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So 

D{t') - D{t) = {x{t) A 1) - {x{t') A 1) + h{t') - h{t) 



If x(t') < 1, by (A.4), 



rt' ft (A.7) 

+ / [D{t' - s) - D{id)]dG{s) + / [D{t' -s)- D{t - s)]dG{s). 
Jt Jo 



D{t') - D{t) = -X H{Q{s))ds-Qit), 



which is always non-positive; if x(t') > 1, then {x{t) A 1) — (x(t') A 1) < 0. So it follows from (A.7) 
and h{-) being non-increasing that 

D{t') - D{t) < [ [D{t' -s)- D{0)]dG{s) + [ [D{t' - s) - D{t - s)]dG{s) 
Jt Jo 

< / D*dG{s) = D*G{t') < D*G{a), 
Jo 

where the last inequality follows from the assumption that D* is non-negative. Summarizing both 
cases of x{t'), we have 

D{t') - D{t) < max(0, D*G(a)) 

for all t,t' G [0, a] > with t < t' . Taking the supremum on both sides over the set {{t,t') G 
[0,a] x[0,a] -.t < t'} gives D* > F{a)D*. This implies that [1 - G{a)]D* < 0. Since G{a) < 1, 
it contradicts the assumption that D* > 0. So we must have D* < 0, this implies that D{-) 
is non-increasing on [0, a]. We next extend this property to the interval [0, T] using induction. 
Suppose we can show that D{-) is non-decreasing on the interval [0,na] for some n G N. Introduce 
Dnaij) = D{na + t), Xna{t) = x{na + t) and 

ma 

Cna{t) = C{na + t)+ I D{na- s)dG{t + s). (A.8) 
It is clear that the shifted functions satisfy 

{Xna{t) A 1) + Dna{t) = Cna{t) + [ Dna{t " s)dG{s). (A.9) 

Jo 

To show that D{-) is non-increasing on [na, {n + l)a] is the same as to show that Dna{') is non- 
increasing on [0,a]. For this purpose, it is enough to verify that Cna(') satisfy the condition (A. 6). 
Performing integration by parts on (A.8) gives 

j-na 

Cna{t) = h{na + t) + (C(0) - 1)+ [1 - G{na + t)]+ / D{na - s)dG{t + s) 

Jo 

= h{na + t) + (C(0) - !)+[! - G{na + t)] 

rna 

+ D(0)G(na + t)- D{na)G{t) - G{t + s)dD{na - s). 

Jo 
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It follows from (A.l) and (A.4) that D{0) = (C(0) - 1)+, so we can write Cna(-) as 

Cna{t) = Ka{t) + Dr^ami - Git)], 

where Ka{t) = h{na + t) + (C(0) - 1)+ - Dna{0) - Jo" G{t + s)dD{na - s). Since G(-) is non- 
decreasing and D{-) is non-increasing, the integral — j^"' G{t + s)dD{na — s) is non-increasing as a 
function of t. So we can conclude that hna{-) is non-increasing, i.e. Cna(') satisfies condition (A. 6). 
Thus, we extend the non-increasing interval to [0, (n -|- l)a]. By induction, the function D{-) is 
non- increasing on the interval [0, T]. □ 



B Glivenko-Cantelli Estimates 



An important preliminary result is the following Glivenko-Cantelli estimate. It is used in Section 5. 
It is convenient to state it as a general result, since the Glivenko-Cantelli estimate requires weaker 
conditions and gives stronger results than those in this paper. 

For each n, let {uf be a sequence of i.i.d. random variables with probability measure y^i-)-, 
let {u[^}jg2 be a sequence of i.i.d. random variables with probability measure i^q{-)- For any 
n,m G Z and / S M+, define 

m+[nl] 

CUm,l) = - 5u^, (B.l) 

i=m+l 

m+[nZJ 

Ll(iJi,l) = - V <5„n, (B.2) 
n ^-^ ' 

i=m+l 

£"(m,/) = - V (B.3) 

i=m+l 

where denotes the Dirac measure of point x on M and '5(x,3/) denotes the Dirac measure of point 
(x, ?/) on M X M. So C^{m, I) and CQ{m, I) are measures on M and C"'{m, I) is a measure on M x M. 

Denote G^ = (x, oo), for all x G M. We define two classes of testing functions by 

r = {lc.(.):xGM}, 

r2 = {lc^xCy{;-)-x,yeR]. 

It is clear that is a set of functions on M and is a set of functions on M x M. Define an envelop 
function for Y as follows. Since i/p ^ lyp, by Skorohod representation theorem, there exists random 
variables X" (with law i/p) and X (with law i/p), such that X almost surely as r ^ oo. 

Thus there exists a random variable X* such that almost surely, 

X* =supX". 
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Let I'p be the law of X* . Since L2{vp) (the space of square integrable functions with respect to 
the measure v*p) contains continuous unbounded functions, there exists a continuous unbounded 
function fy^ : M+ M that is increasing, satisfies f^p > 1 and {f^p^vp) < oo. Similarly, based 
on the weak convergence — > fc, we can construct a function fi,^ that is increasing, satisfies 
fuQ ^ 1 aiid (/^q,^'g) < CO. Now, define function / : R+ — > M by f{x) = min {fup{x), fuQ{x)) and 
function /2 : M+ x — > M by f2{x, y) = min {fyp{x), fuciv)) for all x, y € M+. Note that we have 
to following properties. 



/ is increasing and unbounded, 
/ < / for all / G r, 
f<h for all / G 



(B.4) 
(B.5) 
(B.6) 



So we call / and /2 the envelop function for Y and Y2 respectively. Finally, let Y = {/} U Y and 

% = {f2}y^Y2. 



Lemma B.l. Assume that 

Up ^ up, 

Fix constants M, L > 0. For all e,r] > 0, 



ug as n 



00. 



limsupP" 

n^oo 

limsupP" 

n^oo 

limsupP" 



max sup sup 



max sup sup 

-nM<m<nA/;g[o,L] /er 

max sup sup 

-nM<m<nM i^^Q ,^-^ /e^a 



{f,CUm,l))-l{f,u^) 
{f,Cl{m,l))-l{f,v^) 

{f,r{m,l))-l{f,{v^P,v2;)) 



> ej < 7?, 

> < r/. 



> e <rj. 



This kind of results have been widely used in the study of measure valued processes, see [8, 10, 
31]. The proof of the first two inequalities in the above lemma follows exactly the same way as the 
one for Lemma in [31], and the proof of the third inequality in the above lemma follows exactly 
the same as the one for Lemma 5.1 in [10]. We omit the proof for brevity. By the same reasoning 
as for Lemma 5.2, there exists a function eGc(')> which vanishes at infinity such that the e and r/ 
in the above lemma can be replaced by the function eGc(^) foi" each index n. Based on this, we 
construct the following event, 

{f,CUm,l))-l{f,v^p) 



^GC 



(M, L) = < max sup sup 

L -nM<m<nM ig[o,L] jg // 

< max sup sup 

L -nM<m<nM ;g[o,L] jgy 



max sup sup 



{f,CUm,l))-l{f,u2; 
(/,£"(m,/))-/(/,(i.]^,z.S)) 



(B.7) 



It is clear that for any fixed M, L > 0, 

lim P"(J7gc(^A^) 
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Intuitively, on the event Qqq{M, L) (whose probabihty goes to 1 as n ^ oo for any fixed constants 
M,L), the measures Cp{m,l), £.^{771, 1) and C"'{m,l) are very "close" to li^p, Ivq and 1{vp,Vq), 
respectively. 

C An Extension of Skorohod Representation Theorem 

In this section, we present a slight extension, Lemma C.l below, of the Skorohod Representation 
Theorem (c.f. Theorem 3.2.2 in [26]). The proof of Lemma C.l is built on the proof of Theorem 3.2.2 
provided in the supplement of [26], with slight extension to deal with the product of two matric 
spaces. 

Let (Ei,7ri) and (E2,'/r2) be two complete and separable metric spaces. Let (Ei x E2,7r) denote 
the product space of them, with the product metric vr obtained by the maximum metric. 

Lemma C.l. Consider a sequence of random variables > 1} in the product space 

El X E2. If Xn X, then there exists other random elements o/Ei x E2, > 1}, and 

X, defined on a common underlying probability space, such that 

{Xn,Yn) = {Xn,Yn),n>l, X = X 

and almost surely, 

Xn —^X as n ^ 00. 

Proof. In order to present the proof, we first need some preliminaries. A nested family of countably 
partitions of a set A is a collection of subsets j4jj^...^jj, indexed by A;-tuples of positive integers such 
that {Ai : i > 1} is a partition of A and {^ii,..., 4^.^.1 : ik+i > 1} is a partition of j4jj^...^jj, for all /c > 1 
and (zi, . . . , ifc) E N^. Let Pi denote the probability measure on the space where X lives on. Since 
the space (Ei,7ri) is separable, according to Lemma 1.9 in the supplement of [26], there exists a 
nested family of countably partitions {E}^ j^} of (Ei,7ri) that satisfies 

rad(4,...,J < 2-^ (C.l) 

IPi(54,...,iJ = 0' (C-2) 

where rad(A) denotes the radius of the set A in a metric space, and d{A) denote the boundary of 
the set A. Since the space (E2,7r2) is separable, by the same lemma, there exists a nested sequence 
of countably partitions {E"^, } of (E2,7r2) that satisfies 

1'"'' k' 

rad(E2 ...^,,J<2-^'. (C.3) 

Note that for space (E2,7r2), we only need a weaker version of Lemma 1.9 in the supplement of 
[26]. 
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The first step is to use ttiis nested sequence of countably partitions to construct random variables 
{{Xn,Yn),n > 1} witli tlie same distribution for each n. For n > 1, we first construct subintervals 
lil i^. ^ [0, 1) corresponding to the marg inal probabihty of X„. Let Ij" = [Q,¥''{E\ x E2)) and 



i-l 



/-= [J]P"(4 xE2),j;P'^(4 XE2)), ^>1' 



where is the probability measure on the space where (X„,l^) lives. Let ^^^^ : ik+i > 1} 

be a countable partition of subintervals of If^ If If^ = [a„, then 



jn / ittI 



The length of each subinterval J^" is the probability P"(£'j-^ x E2). We then construct 
further subintervals If ■ .., ., C If corresponding to {Xn-,Yn). If If ,■ = fon,6„), then 
let /f„...,.,;i = K,a„ + P"(4^,„,,^ X and 



7-n 



i'-i i' 
x„ + ^P"(4,...,^. X 4),a„ + j;P"(E/^„„,,^ X 4)), i' > 1. 
i'=i j'=i 



Let {-^J! 7' : ^ 1} be countable partition of/" . ., ./-If/" ,/ =[an,6„) 

then 



fc' + l 



a„ + J] F"(4„„,^ X i?|,...,,,,,),«n + E X El 

j'=i j'=i 



The length of each subinterval I^ ■ ■, is the probability ¥'^{E} ,• x E , ., ). Now from 
each nonempty subset E'^^^ x E"^, we choose one point For each n > 1 and 

A; > 1, we define functions (x^, y^) : [0, 1) ^ Ei x E2 by letting x'^{w) = and y^(u)) = yii^^,,,^ii^ 

for uj £ If ■ .., ., . By the nested partition property and inequalities C.l and C.3, 

7r((x^(a;),x^H),(x^^-(u;),x^^M)) <2~'^ foraUj,A:,n 

and to G [0,1). Since (Ei x E2,7r) is a complete metric space, the above implies that there is 
yn(a;)) G Ei x E2 such that 

7r((x^(a;),x^;(a;)), (x„(a;),x„(a;))) ^0 as k ^ 00. 

We let iXn,Y„) = {xn,yn) on [0, 1) for n > 0. 

The next step is to construct X and show that X„, — > X almost surely. For each n > 1, let 
P" denote the marginal probability of X^. It is clear that J^" is the probability F'^{Ej_^ ■^). 
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By (C.2), we have that P"(£'j^^^ ^^^) Pi(£'/^^ ,;^), as n ^ oo. Consequently, the length of the 
interval 1^" converges to the length of the interval which is defined in a similar way as 

for /j" by letting 



— [o-mbn). Now from each nonempty subset Eii,...^if. we choose one point For 
each A; > 1, we define functions : [0, 1) — > Ei by letting x^{uj) = for to € I^" j^. By the 

nested partition property and inequalities C.l, 

7ri{x''{u),x''+^{uj)) < for all j, k 

and uj S [0, 1). Since (Ei,7ri) is a complete metric space, the above implies that there is x{uj) E Ei 
such that 

tti{x^{lli),x{uj)) ^0 as A; — i- cxD. 

We let X = rr on [0, 1). Since 

vri (X„ (a;) , 1 (cj) ) < vri (X„ (a;) , 1^ (a;) ) + vn (X^ (c^) , (c^) ) + vn (1^ (c^) , X (u;) ) 
< 3 X 2"'', 

for all oj in the interior of 

lim 7ri(X„(a;),X(L^)) < 3 x 2'''. 

Since A; is arbitrary, we must have X„(a;) ^i^) as n ^ oo for all but at most countably many 
u € [0,1). 

It remains to show that (X„, y„) has the probability laws P". Let P denote the Lebesque measure 
on [0, 1). It suffices to show that P((X„,y„) e A) = P'^(A) for each A such that F'^idA) = 0. Let 
A be such a set. Let A'' be the union of the sets E} x E'^, ., such that Ej x E'v Q A 
and let A''' be the union of the sets Ej ■ x E^, ., such that Ej ■ x E^, ., n A ^ 0. Then 

C ^ C A' and, by the construction above, 

p((x„,y„) G A'') = p"(A^-) and p((x„,y;) G A'*^) = P'^(A'*^) 

Now let C'' = {s G El X E2 : 7r(s, < 2"'=}. Then A''' - A'' i dA as k ^ 00. Since P"((9y4) = 
by assumption, P"(C'^) J, as A; ^ 00. Hence 

P((X„,y„) G yl) = lim P((X„,y„) G A^-) = lim P"(A^-) = P"(yl). 

fc— >oo fc— too 

Following the same way, we can show that X has probability law Pi. □ 
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